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Abstract 

Homomorphism duality pairs play crucial role in the theory of relational 
structures and in the Constraint Satisfaction Problem. The case where 
both classes are finite is fully characterized. The case when both side are 
infinite seems to be very complex. It is also known that no finite-infinite 
duality pair is possible if we make the additional restriction that both classes 
are antichains. In this paper we characterize the infinite-finite antichain 
dualities and infinite-finite dualities with trees or forest on the left hand 
side. This work builds on our earlier papers [2| that gave several examples 
of infinite-finite antichain duality pairs of directed graphs and [3] giving a 
complete characterization for caterpillar dualities. 

Keywords: graph homomorphism; duality pairs; general relational 
structures; constraint satisfaction problems; regular languages 



1. Introduction 

In this paper we consider relational structures and homomorphisms be- 
tween them. See the definitions of these and all other notions left undefined 
in this Introduction in the next section. 

For this paper we fix a finite type a and consider only finite relational 
structures of this type. The simplest non-trivial type consist of a single 
binary relation symbol. Relational structures of this type are directed graphs 
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with no parallel edges but possible loops. Our results are meaningful for 
directed graphs and although we strive here for generality the reader can 
concentrate on directed graphs. 

A homomorphism duality pair or simply a duality pair is a pair (A, T>) 
of families of a-structures satisfying that for every a-structure B we have 
either A — >■ B for some A € A or B — > D for some D € T> but not both. 
Here we wrote X — > Y to indicate that existence of a homomorphism from 
X to Y. If (A,T>) is a duality pair we call V a dual of A. Note, however, 
that this relation is not symmetric. 

It is a trivial observation that any family A of cr-structures has a dual 
family T>. Indeed, simply take T> = {D |/3A € A : A — > D}. For any 
family T> one can similarly set A = {A € T> : A — > D} making (.A, P) 
a duality pair. Because of this abundance it is not reasonable to hope for 
a meaningful characterization of all duality pairs. But characterization of 
restricted classes of duality pairs have been already done successfully. For 
the case when both sides are finite see jij. In case we restrict attention to 
antichains, then there is no finite-infinite duality pairs (see [l[ for a proof for 
directed graphs that readily generalizes to arbitrary relational structures). 
In this paper we concentrate on duality pairs with T> finite and A consisting 
of <T-forests. As we will see this includes the interesting case of duality pairs 
with T> finite and A an antichain. We give a characterization of these tree- 
or forest-dualities from an unusual perspective. Instead of asking what finite 
families V of a-structures have a set A of a- forests with (A, V) a duality 
pair — a question that already has a satisfactory answer, see @, 0], we 
concentrate on the reverse question: what sets A of c-forests have a finite 
dual. The answer to this question involves the notion of a regular set of o~- 
forests. We introduce this notion that generalizes that of regular languages 
and is closely related (but not identical) to other definitions using automata, 
see 

Our main results are as follows. 

Theorem 1.1. A regular family of a -forests has a finite dual. 

Theorem 1.2. The family A of sigma- forests has a finite dual if and only 
if its upward closure UP(„4) is regular. 

Theorem 1.3. An antichain of core a -structures has a finite dual if and 
only if it is a regular family of a -forests. 

By Lemmas 12.41 and 12.51 each of the above three theorems remains valid 
if we replace the phrases "cr-forest" and "finite dual" in them by "u-tree" 
and "singleton dual", respectively. 

Theorems 1 1 . 1 1 and 1 1 . 2 1 generalize the results in [3|], where we concentrated 
on sets A of so called caterpillars that are special u-trees. For this special 
case the notion of regular languages proved sufficient. In Q] we also dealt 
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with tree, forest, and antichain dualities, but restricted attention to directed 
graphs and to concrete examples of such duality pairs. 

In the next section we give all the definitions and then generalize three 
simple observations made in 0] from directed graphs to general relational 
structures. In Section [3l 2] and [5] we prove Theorems II. 2\ 11.11 and 11.31 
respectively. 

2. Preliminaries 

A type a of a relational structures is a family of relation symbols with 
a positive integer arity associated with each. A relational structure A of 
this type (a a-structure for short) is given by a universe U (A) and for each 
relation symbol Q in a its implementation: a relation Q(A) C U (A) r , where 
r is the arity of Q. 

In this paper we consider finite types (i.e., finitely many relation symbols) 
and finite structures (i.e., the universe is finite). Furthermore we consider a 
fixed for the entire paper. 

For two cr-structures A and B we call a function <f> : U(A.) — > U(B) a 
homomorphism if we have (<f>{x\), . . . , 4>{x r )) G Q(B) whenever Q is an r-ary 
relation symbol and (cci, . . . ,x r ) G <5(A). We denote this by <p : A — > B. 
We write A — > B if a homomorphism from A to B exists: this is a transitive 
and reflexive relation. We use the words automorphism, isomorphism and 
isomorphism class in their obvious meaning. 

If A — > B does not hold, we write A B. If A -f± B for all elements 
A 7^ B of a set A of cr-structures we call A and antichain. 

If both A — > B and B — > A hold for a pair of cr-structures we say that 
A and B are equivalent. This is clearly an equivalence relation. In any 
equivalence class the cr-structure with the smallest finite universe is unique 
up to isomorphism. We call such a structure a core and also the core of any 
structure in its equivalence class. We say a a-structure A is minimal in a 
family A, if A G A and any structure B G A with B — > A is equivalent 
to A. We define maximal in a family of structures similarly, but with the 
homomorphism condition reversed. Note that there are two-way infinite 
chains among relational structures (even graphs), so infinite classes do not 
always have minimal or maximal elements. 

Clearly, each structure in A and T> can be replaced with its core to obtain 
another duality pair (A', V) so we can (and often will) assume that both 
sides of a duality pair consist of cores. Further if A G A is not minimal we 
can remove it from A without ruining the duality pair property. This way, 
if A is finite we can replace it with the set A" of its minimal elements (and 
keeping a single copy of equivalent cr-structures) we obtain a duality pair 
(A",T>) with A" C A an antichain. Similarly, if T> is finite we can replace 
it with the set T>" of its maximal elements to obtain a duality pair (A, T>") 
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with T>" being an antichain. Note however that such transformations are 
not possible in general for infinite families. 

A cr-structure A may be described by its bipartite incidence multigraph 
Inc(A) defined as follows. The two parts of the vertex set of Inc(A) are 
C/(A) and Block(A), where 

Block(A) = {(Q, z) | Q is a relation symbol and z G Q(A)}, 

and with edges es,i joining the block B = (Q, (x±, . . . , x r )) G Block(A) with 
Xi for i = 1, . . . , r. The degree of the block B = (Q, z) in Inc(A) is precisely 
r, the arity of Q. But some of the edges incident to B may be parallel, so 
it may have fewer than r neighbors in U(A). Note that a homomorphism 
(f> : A — >■ B induces a graph homomorphism Inc(A) —¥ Inc(B) mapping 
[7(A) to U(B) and Block(A) to Block(B). The converse is also true if the 
graph-homomorphism preserves the relation symbol Q as the label on the 
block (Q,z) and the index i as label on the edge es,i- 

A cr-structure A is called a a-tree or a o-forest if Inc(A)) is a tree or a 
forest, respectively. Similarly, we call A connected if Inc(A) is connected. 

Notice that for directed graphs one obtains the incidence multigraph by 
first considering the underlying undirected graph and then subdividing each 
of its edges. Thus we call a directed graph a tree, a forest or connected 
if the underlying undirected graph is indeed a tree, a forest or connected, 
respectively. 

2. 1 . Regular families of forests 

We denote by T the set of isomorphism classes of c-trees, and let F be the 
set of isomorphism classes of cr-forests. Let D\ denote the set of isomorphism 
classes of rooted cr-forests: members of *R are (isomorphism classes of) cr- 
forests with an arbitrary element of the universe designated as root. We 
introduce two operations: 

(i) unrooting [.] : *R — > F forgets the root; 

(ii) combining + : $\ x 9\ — > 91 takes the disjoint union of two rooted 
forests and identifies their roots. 

We call a set R C F regular if 
{R z I z G 9i} 

We define the equivalence relation ~ R on d\ by setting x ~ R y if for all 
z G y\ we have [x + z] G R if and only if [y + z] G R and say R C F is 
regular if has finitely many equivalence classes. Note that x y if and 
only if R x = R y , so the two definitions are equivalent. They are analogous 
with the following definition of regular languages based on the Myhill-Nerode 
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where R z = ^VK [z + w] G i?| . 
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theorem. A language L C S* is regular if the infinitely many words a € X* 
define only finitely many distinct extension sets L a = {b € X* | a& € L}. 
Here X is the finite alphabet. We will see an even closer connection between 
regular sets of caterpillars (see [3]) and regular languages. 

We defined F to consist of isomorphism classes to emphasize that we do 
not distinguish between isomorphic er-forests. But we will abuse notation 
somewhat by identifying the isomorphism class with a representative a- 
forest and speak of regular families of a-forests (as in Theorems [LTJ [L2] and 
1 1 . 3 j) to mean that the corresponding family of isomorphism classes form a 
regular set. Similarly, we use the notation x —> y for x,y € F to mean that 
a homomorphism exists between the elements of these classes. 

For a family R C F let us define its upward closure as UP(-R) = {x £ F | 
By € R : y — > x}. 

Let us comment on how our main result Theorem 11.21 relates to the 
results of the earlier paper 0]. There we restricted attention to a subclass 
of <7-trees called caterpillars. A caterpillar is a cr-tree A such that Inc(A) 
has a path going through all the non-leaf vertices in U(A). The advantage 
of considering caterpillars is that they can be described by words over a 
finite alphabet 02 obtained from the type a. One does not have to define 
regular sets of caterpillars but can rely on the well developed theory of 
regular languages instead. We state the connection between our definition 
of "regular" as it applies to caterpillars and regular languages. 

Lemma 2.1. A set C of caterpillars is a regular family of a-trees if and only 
if the set of words over 02 that describe the elements of C form a regular 
language. 

See the definition of 0*2 is and how words over 02 describe caterpillars in 
0]. We leave the simple proof to the reader. 

Let us consider the special case of the type of directed graphs. A directed 
graph is a caterpillar if it is an orientation of a tree that has path going 
through all of its non-leaf vertices. Words describing paths was also used 
in [2|. Here the correspondence is very simple: a word X\ . . . € {+, — } k 
describes the orientation p{x) of the k edge path whose ith edge is directed 
forward if Xi = + and directed backward if X{ = — . Using the lemma above 
and our main results one obtains the following. 

Corollary 2.2. (i) A family C of oriented paths has a finite dual if and 
only if {x E {+, — }* | BP € C : P — > p(x)} is a regular language. 

(ii) An antichain C of oriented paths has a finite dual if and only if {x G 
{+, — }* j p{x) is isomorphic to a member of C} is a regular language. 

Note also that by Lemma 12.41 below (find also in [2| for the directed graph 
case) if a family of oriented paths has a finite dual, then it also has a dual 
consisting of a single directed graph. 
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To finish this section we list three simple observations on duality pairs. 
The corresponding statements for directed graphs are proved in [2j, see The- 
orem 2.1 and Lemmas 2.2 and 2.3 there. Essentially the same proofs work 
in the general case. As Theorem 12.31 is important for the proof of our Theo- 
rem [L3] we spell out its proof in Section [5j Since the other two observations 
are not essential for our results we leave their proof to the interested reader. 

Theorem 2.3. If the family of core a-structures has a finite dual, then its 
minimal elements are a -forests. 

Note that this result implies that if the family A has a finite dual and A G A, 
then the set {B G A | B — > A} either contains a cr-forest or else it is infinite. 

Lemma 2.4. Let (A, T>) be a duality pair of families of a-structures. If all 
a-structures in A are connected and T> is an antichain, then \T>\ = 1. 

Lemma 2.5. Let (A, T>) be a duality pair of families of a-structures. If A 
is an antichain of cores and V is finite, then for any sigma- structure A £ A 
the number of connected components o/Inc(A) is at most \T>\ and the degree 
in Inc(A) of a vertex v G U(A) is at most J2~Dev 

3. The characterization 

In this section we prove the characterization result Theorem 11.21 assuming 
the existence result Theorem II. 11 We give the proof of this latter result in 
the next section. 

Let to denote (the isomorphism class of) the trivial rooted cx-tree: its 
universe consists of a single element, the root, and the implementations of 
all relation symbols are empty. 

We start with the following simple lemma. 

Lemma 3.1. (i) The family of regular sets is closed under union, inter- 
section and complementation. 

(ii) The complete family T of a-trees is regular. 

(iii) The family Hd = {t G ¥\t — > D} is regular for any a-structure D. 

Proof, (i) Let R,SCF. For z G V\ we have (R U S) z = R z U S z , (R n S) z = 
R z n S z and (F \ R) z = 9K \ R z . Thus 

\{(RUS) z \z G JH}| < | {(12* | z G • \{S z \z G 9t}|, 

\{(RnS) z \z G JH}| < | {(12* 1 2i G • \{S z \z G JR}|, 
\{(F\R) z \z£m}\ = \{(R z \z£K}\ 
proving part (i) of the lemma. 
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(ii) T z = if [z] £ T and T z = {a \ [a] G 1} if [z\ G T proving part (ii). 

(iii) For any vertex v G U (D) let S v be the set of the rooted cr-forests 
w G 9\ such that [w] has a homomorphism to D mapping the root of w to u. 
Clearly, for any z £ D\ we have (Hr>) z = \J v . ze g &v since the root of z and 
the root of w must map to the same element in U(D) if [z + w] belongs Hp. 
As the sets (-Hd)z are unions of subsets of the at most | V(Z?) | sets S v one 
can have at most 2^-°) I distinct sets among them. This finishes the proof 
of this last part of the lemma. □ 

Proof of Theorem assuming Theorem li.il If (A, T>) is a duality pair, then 
UP (.4) = F \ Udsx>-^ d ' wnere -f^D is the set of cr-forests having a homo- 
morphism to D. By Lemma l3.1( iii) the sets H& are regular and so by part 
(i) of the same lemma so is UP (4) provided T> is finite. 

For the converse direction assume UP (A) is regular and apply Theo- 
rem 11.11 to find a finite its finite dual T>. Clearly, the same set T> is also a 
dual for A □ 



4. Constructions of duals 

To prove Theorem ll.il we need to construct the finite dual of a regular family 
of cr-forests. So far, we have treated cr-trees and not connected cr- forests in 
a uniform way. But for this construction it is convenient to first consider 
regular sets consisting of cr-trees only — the dual is a single finite cr-structure 
in this case. 

4-1. Duals of a -trees 

Theorem 4.1. For any regular set R C T there exists a finite a-structure 
D that makes (R, {D}) a duality pair. 

To prove this theorem we give explicit construction of the cr-structure 
D. Let us fix the regular family R of cr-trees. 

Recall that to stands for the trivial rooted tree: a singleton universe with 
empty relations. We have Rt = {w G 91 \ [w] € R} since w + to = w. Let 
9ti = {i G 0t | [i] G 1} stand for the family of rooted cr-trees. 

We will need another construction combining cr-trees. Let Q be a rela- 
tion symbol in cr of arity r, and let ti E 9\ be rooted cr-trees for i = 1, . . . , r. 
We define C(Q, (ti, . . . , t r )) to be the cr-tree obtained by taking the union of 
pairwise disjoint copies of ti and adding a single new block to their union con- 
necting their roots by the relation Q. More formally let Tj be a cr-structure 
from the isomorphism class [ti] with Xj G J7(Tj) corresponding to the root of 
ti and assume the universes U(Ti) are pairwise disjoint. We define the cr-tree 
C representing C(Q, (t u . . . ,t r )) by setting U(C) = U[=i^( T 0> <9(C) = 

U<=1 ^( T *) U • • • ' x r)} and Q'( C ) = U=i Q'( T i) for all relation sym- 
bols Q' in cr other than Q. For j = 1, . . . , r we define Cj(Q, (t±, . . . , t r )) G 9\ 
by designating Xj as root in C. 
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Definition of the cr-structure D: We define the universe U = U(D) of D 
to consist of certain subsets 9\i \ Rt , namely those that contain to and can 
be obtained as the intersection of sets of the form y\\ \ R z . 

For a relation symbol Q of arity r in a we define Q(D) as follows. For 
z = (Vi, . . . , V r ) G U r we have z G Q(D) if Cj(Q, (t x , . . . , t r )) G Vj holds for 
all j = 1, . . . , r and all <T-trees ti G Vi, where i = 1, . . . , r. 

For f G SR, a cr-structure A and V G f7 (A) we write t — > (V, A) to signify 
that there exists of a homomorphism from (a representative of) [t] to A 
mapping the root of t to V. 

Lemma 4.2. // t -> (V,D) Zio/cfe /or some t G SHi and V G C/(D), £/ien 
t G V. 

Proof. We prove this claim by induction on the size of Block(i). The base 
case is t = to with |Block(t)| = 0. Here t G V by the definition of the 
universe of D. 

Assume now |Block(D)| > and the lemma holds for smaller rooted 
cr-trees. Let (Q, (x±, . . . , x r ) be a neighbor of the root in Inc(t). This means 
that Q is an r-ary relation symbol in a, we have (xi,...,x r ) G 
and the root of t is Xj for some 1 < j < r. We can further write t = 
Cj(Q, (ti, . . . , t r )), where each of the a-trees t{ for i = 1, . . . ,r are smaller 
than t. Restricting the homomorphism t — > (V, D) we get ti —> (Vi,D) 
for i = 1, . . . , r, where the vertices Vi G U (D) satisfy (V\, . . . , V r ) G Q(D) 
and Vj = V. Using the inductive hypothesis U — > (T^,D) implies ti G 
V. Applying the definition of Q(D) for (Vi,...,V r ) G Q(D) we get t = 
Cj(Q, (t±, . . . , t r )) G Vj = V finishing the proof of the lemma. □ 

Proof of Theorem \4.1\ We need to prove that (R, {D}) is a duality pair, 
that is, for every cr-structure B one has B — > D if and only if no t G R 
satisfies t — > B. 

For the "only if" part assume that t — > B — > D holds for some i 6 fi. 
Thus we also have t — > D, and making an arbitrary vertex of t the root 
we obtain t' G 9t with [t'] = t and t' -> (V, D) for a vertex V G C7(D). 
By Lemma 14.21 we have t' G V contradicting the facts that t' G Rt and 
V C \ i? to . The contradiction proves this half of the statement. 

In the rest of this proof we concentrate on the "if" part. We assume 
t -ft B for all t G R, define a map (j) : U(B) — > U(D) and prove it is a 
homomorphism. 

For V G 17(B) we define Sy = G 9*i | t -> (V,B)}. Note that 
to G Sy holds trivially and Sy G SKi \ -Ri by our assumption that t D 
for t € R. Still, Sy is not necessarily contained in U(D) as it does not need 
to be expressible in the required intersection form. So we let <p{V) be the 
"closure" of Sy, the smallest set in {7(D) containing 5y. In formula this 
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means 

<t>{V) = p| (Kl\Ry). 

ye^i:Ry<lS v =$ 

It remains to prove that c/> is a homomorphism, namely that for an 
r-ary relation symbol Q in cr and for any (x\, . . . ,x r ) G Q(B) we have 
((^(xi), . . . , <f>(x r )) G Q(D). Applying the definition of Q(D) we need to 
prove that for all ti G (f)(xi) for i = 1, . . . ,r and for 1 < j < r we have 
t G <p{xj) for t = Cj(Q, (ti, . . . , i r )). We prove this last statement by induc- 
tion on the number of indices i with ti ^ S Xi . 

If £j € S Xi for all i, then we can combine the homomorphisms ti — > (xj, B) 
to obtain a homomorphism t — > (xj, B) proving t G S^. C (f)(xj). This proves 
the base case of the induction. 

Assume now that there exists an index i for which ti ^ S Xi . We are 
going to replace ti with another rooted a-tree t • G S*^ and use the inductive 
hypothesis for this modified collection of trees. 

Assume for a contradiction that t ^ 4»{xj). By the definition of (f> this 
means that for some y G JHi satisfying i? y n iS Xj = we have t £ R y and thus 
[t+y] G i?. Consider the r-tuple z = (ti, . . . , t r ) and obtain z* from z by first 
replacing its ith coordinate ti by to an d then adding y to the jth coordinate. 
In case i = j this means ti in z is replaced by y in z*, while in case i 7^ j 
we obtain z* from z by replacing ij and tj by to an d + y, respectively. 
With t* = Ci(Q, z*) moving the root shows [U + t*\ = [t + y] G R and thus 
ti G Rt*- From ti G </>(xj) (and the definition of (f>) we conclude that Rf 
and S Xi are not disjoint. Let us choose t\ G fl S Xi . Let us obtain z' 
from z by replacing the ith coordinate U by ^ and set t' = Cj(Q,z'). We 
have [t' + y] = [t* + ^] (by moving the root as above) and [t* + t'^ G R 
since t^ G Rt*)- Thus we also have t' G it^ and thus t' ^ 4>(%j)- This shows 
that the r-tuple z' also violates our claim. But as ti ^ S Xi was replaced by 
t ■ G 5 Xj this contradicts our inductive hypothesis. The contradiction finishes 
the proof of the "if" part of our main statement and with that it proves the 
theorem. □ 

4-2. Duals of a -forests 

Let us abuse notation by denoting the disjoint union operation of o- 
forests in F (no roots) by the same + sign as we used for the combining 
operation of rooted forests. The components of Inc(z) determine the essen- 
tially unique way to decompose a cr-forest as the sum of cr-trees. We call 
these a-trees the components of z. 

For a set R C F and z G F let R z = {w G F | z + w G R}. Let us call 
z, z' G F ^-equivalent if R z = R z . (This definition should not be confused 
with an equivalence relation on rooted cr-forests.) In this section we 
will be mainly interested in ^-equivalence among d-trees: two a-trees are 
-R-equivalent if replacing a component isomorphic to one with a component 
isomorphic to the other does not change membership of the cr-forest in R. 
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Lemma 4.3. If R C F is regular, then R-equivalence partitions F into 
finitely many regular sets. 

Proof. Let z 6 F be a non-empty c-forest and choose an arbitrary root 
vertex in U(z) to obtain t £ F with [t] = z. Now the elements of R z can 
be obtained from Rt by considering only those elements of Rt where the 
root is isolated in the incidence graph and deleting the root from these a- 
forests. Thus Rt determines R z and as we assume that there are finitely 
many distinct sets Rt, the same must hold for the sets R z . (Note that 
the converse is not always true, for some non-regular sets R there are only 
finitely many sets R z — this is the case, in particular, if R C T.) 

-R-equivalence partitions F into finitely many equivalence classes. Each 
one of them, therefore, can be characterized by a finite list of cr-forests 
they contain or do not contain. If we show that one such condition defines a 
regular set, namely R w = {z € F | z+w € R} is regular for every w £¥, then 
by Lemma IBTTT i) all equivalence classes are regular. We have (R w ) x = R y , 
where y is obtained as the disjoint union of the rooted a- forest x and the 
non-rooted cr-forest w keeping the root of x as the root of the union. As R 
is regular, there are only finitely many such sets, so R w must also be regular 
finishing the proof of the lemma. □ 

Proof of Theorem li.il This is a constructive proof. As in the proof of The- 
orem S?T] w e start by constructing the dual T> for the regular family R. 

We call a family SCT suitable for R if it consist of the a-trees within 
the union of certain ^-equivalence classes and if for each a- forest in R one of 
its components appears in S. By Lemmas 14.31 and 13. II there are finitely many 
suitable families for R and each of them is regular. So by Theorem 14.11 each 
suitable family S has a finite dual: a a-structure D5 such that (S, {D5}) is 
a duality pair. We select one such dual cx-structure for each suitable family 
and define T> to be their collection. 

To prove that (R, T>) is a duality pair we consider an arbitrary a-structure 
B and prove that B — > D for some D £ T> or z — > B for some z € R but 
not both. 

The second statement is simpler to prove. If both assertions hold, then 
we have z — > B — > D for some z £ R and D = with a suitable family S. 
As S contains a component t of z we also have t — > B — > contradicting 
the fact that (S, {Ds}) is a duality pair. 

For the first statement consider the i?-equivalence classes containing no 
cr-tree t with t — > B and let S be the collection of c-trees in their union. If 
S is suitable we must have B — > D5 since (5, {D5}) is a duality pair. If S 
is not suitable we must have a cr-forest z £ R consisting of the components 
ti, . . . , t}. such that none of the a-trees t, appear in S. So for all i = 1, . . . , k 
we must have a cr-tree t! i that is i?-equivalent with ti satisfying — >■ B. Now 
ti + ■ ■ ■ + tk = z £ R, but replacing a component ti with t • cannot alter 
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membership in R. Switching the components one by one, we conclude that 

z' = ti H h t' k £ R and as all of its components map to B we have z' — > B 

finishing the proof. □ 



5. Antichain dualities 

For the proof of Theorem 11.31 we need to two ingredients. The first is to 
see that if an antichain of cores has a finite dual, then the antichain consists 
of a- forests. This follows easily from Theorem 1 2 . 3 1 which we will prove here. 
The second is to prove that whenever the upward closure UP (.A) of an 
antichain A of core cr-forests is regular, so is A itself. This follows from the 
following more general observation. 

Theorem 5.1. The cores of the minimal elements of a regular set of cr- 
forests form a regular set. 

This result is more subtle than it looks. There are regular families A 
such that none of (a) the minimal elements in A, (b) the cores among the 
elements of A, or (c) the cores of all elements in A form regular languages. 
To see this, consider the type of directed graphs, consider the family A 

consisting of the oriented paths Py = p(+ + (H h) 1 + H ( — I — ) 3 ' ). 

(See the definition of the operation p before Corollary 12.21 ) Here Pij is core 
if and only if i ^ j. The minimal elements in A are the oriented paths Pa. 

The core of Pa is p(+ + (H + +) and these latter oriented paths do 

form a regular set as opposed to the sets mentioned in (a-c). 

We start with the proof of Theorem 11.31 from the two results mentioned 
above and continue with proving both of those results. 

Proof of Theorem M.cA using Theorems \2.'J\ and I5.il The "if" part of the state- 
ment readily follows from Theorem ll.il 

For the "only if" part assume A is an antichain of core cr-structures and 
it has a finite dual. By Theorem 12.31 and since all elements of an antichain 
are minimal, A must consist of a-forests. Applying Theorem 11.21 we obtain 
that UP (A) is regular. But the cores of the minimal elements in UP (.A) are 
exactly the elements of A, so Theorem 1 5 . 1 1 finishes the proof. □ 

Proof of Theorem \2.3l Let A be a family of core cr-structures that has a 
finite dual, assume for contradiction that A contains a minimal element A 
that is no cr-forest. Let C be a cycle in Inc(A) and cba be an edge of C 
connecting a block B = (Qo, z) to some vertex a € U(A). Let us obtain 
the (j-structure A' adding a new element a' to the universe of A (that 
is U(A') = [7(A) U {a 1 }), setting Q(A') = Q(A) for all relation symbols 
Q ^ Qo in S and Qq(A') = (Qq(A) \ {z}) U {z'}, where z' is obtained from 
z by changing its i'th coordinate from a to a'. The map moving a' to a and 
fixing all other elements in U (A') is an A' — > A homomorphism. 
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Let X be an arbitrary tournament with more vertices than the size of 
the universe U (D) of any of the structures D in a fixed finite dual T> of A. 
Let us consider isomorphic copies A' uv of A' for each edge uv of X. Pick 
these copies such that the universes U(A' UV ) are pairwise disjoint except for 
picking the copies of a and a' in each of the cr-structures from the vertex 
set V(X) of X. Namely we use u as the copy of a and v as the copy of a' in 
A.' uv . We obtain the cr-structure C by taking the union of these structures: 
U(C) = {J uveE(X ) U(A' UV ) and Q(C) = {J uveE{X )Q( A uv) for any relation 
symbol Q. 

Note that the natural A' — > A homomorphism can be applied on each 
copy A' uv of A' as all the identified vertices are mapped to a. This gives us 
a natural homomorphism g : C — > A. 

As (A, T>) is a duality pair we either have a cr-structure B G A with 
B — > C or a cr-structure D G T> with a homomorphism c/> : C — > D. In 
the latter case by the pigeonhole principle we must have 4>(u) = 4>(v) for an 
edge uv of X. Thus c/> restricted to A' uv induces an A — > D homomorphism, 
a clear contradiction. This leaves the former possibility only: B — > C for 
some B G A. From the minimality of A in A and the homomorphisms 
B — > C — >■ A we conclude that A — > B. Using B — >• C again we find 
there is a homomorphism c/> : A — >• C. As A is a core the homomorphism 
gocp : A — > A must be an automorphism. Modifying c/> appropriately, one can 
assume without loss of generality that g o <fi is the identity, so 4>{x) € g^ 1 (x) 
for each x G U(A). We must have c/>(a) G 5~ 1 (a) = U(X) and 4>(x) £ V(X) 
for any other element x of the universe of A. We know that induces a 
graph homomorphism from Inc(A) to Inc(C). All the vertices of the cycle 
C except a maps to Inc(C) — V{X) and thus they map to a single connected 
component of that graph, in particular, they map to Ixic{A' uv ) for a single 
edge uv G E(X). The condition cfi(x) G g~ 1 (x) uniquely determines within 
Inc(A^) the images of all the vertices of C except for a. The edges incident 
to a in the cycle C now represent two contradicting requirement for where 
4> should map a. One of them is es,i, it forces 0(a) = v, while the other 
forces (j)(a) = u. The contradiction finishes the proof of the theorem. □ 

Before proving Theorem l5.1l we rephrase it using the following definition. 
We call a homomorphism h : A — >■ B real if there is no homomorphism 
g : B — > A with h o g : B — > B an isomorphism (or equivalently, the 
identity). Note that if h is not real, then A and B are equivalent. The 
following characterization of real homomorphisms will be useful. It uses the 
notion substructures: a cr-structure A is a substructure of B (in notation: 
A C B) if the universe and relations of A are subsets of the corresponding 
families for B. In this case any B — > C homomorphism can be restricted to 
A to obtain an A — > C homomorphism. 

Proposition 5.2. A homomorphism h : A — )■ B is real if and only if 
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there is a connected component C of B such that the restriction of h to no 
substructure D C A gives a D — > C isomorphism. 

Proof. If h o g : B — > B is an isomorphism and C is a component of B, then 
the restriction of h to the substructure D of A induced by the image of C 
under g is an isomorphism D — > C. 

Conversely, if there is such a structure D, for each component C of B, 
then the inverses gc of the D — > C isomorphisms give the homomorphism 
g : B — > A as their union showing that h is not real. □ 

For fiCFwe define EX(i?) = {a E F | 3t E i? and a real homomorphism 
h : t — Y a}. 

Proposition 5.3. For R C F the family UP(i?) \ EX(,R) is the set of the 

cores of the minimal elements in R. 

Proof. Let a € F be equivalent with a minimal element b of R. Clearly, 
b — >■ a ensures that a € UP(i?). If we also have a S EX(i£), then we have 
a real homomorphism h : t — > a with t & R. From the minimality of b 
and from £ — > a — > b we also have b —> t and hence also a homomorphism 
g : a t. As /i is real /i o g : a — > a is no isomorphism, so a cannot be a 
core. By this we showed that the cores of the minimal elements of R are 
contained in UP(i?) \ EX(R). 

It remains to show that each u-forest a € UP(i?) \ EX(i?) is indeed the 
core of a minimal element of R. From a 6 UP(i?) we have a homomorphism 
h : b — > a with some b S R. As a ^ EX(i?) the homomorphism /i is not 
real and in particular a is equivalent to b. To show that b is minimal in R 
consider an arbitrary c S i? with c — > b and note that c — ?• 6 — > a implies 
(as above) that c and a (and hence also c and 6) are equivalent. Finally 
let us consider an arbitrary homomorphism <j> : a — > a. The homomorphism 
(f) o /i : 6 — > a is not real, so we have 5 : a — > 6 with § oho g : a a an 
isomorphism. This implies that (/> itself must be an automorphism and thus 
a is a core. This finishes the proof of the proposition. □ 

Recall that by Lemma l3.1f i) the difference between regular sets is also 
regular. Thus Proposition 15.31 above and the following two propositions 
together imply Theorem 15.11 

Proposition 5.4. For a regular set R CF its upward closure UP(i?) is also 
regular. 

Proof. By Theorem 11.11 R has a finite dual. By Theorem 11.21 this implies 
UP(i?) is regular. □ 

Note here that a direct proof of this result would only be slightly simpler 
than the proof of Proposition 15.51 below (by not having to distinguish danger 
points from safe points). The proofs give a doubly exponential bound on the 
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number of equivalence classes of ~up(i?) or ^ex(r) hr terms of the number 
of equivalence classes of ~# and we believe that the number of equivalence 
classes can indeed be that high for some regular sets R. 

Proposition 5.5. For any regular set R C F the set EX(i?) is also regular. 

Proof. For simplicity we assume that the type a contains no unary relations. 
The proof works basically the same way in the presence of unary relations 
too, but making this mild assumption makes our presentation simpler. We 
start with a few definitions. 

Recall that each cr-forest has a unique decomposition as the disjoint 
union (also called as the sum) of cr-trees, its components. 

For x G d\ with root v we denote by x+ the rooted component of x, that 
is G 9\ contains v as its root and [x + ] is a component of [a?]. Let X- 
stand for the union of all remaining components of [x]. For a £ T and a 
homomorphism h : a — > [x] we define h = {w G U(a) \ h(w) = v} to be the 
set of root points, points mapped by h to the root of x. We say that w £ U(a) 
is a danger point of h if a restriction of h to a suitable substructure of a 
containing w is an isomorphism to [x+]. Let h 1 stand for the set of danger 
points of h and note that h 1 C h°. We write h 2 = h° \ h 1 stand for the 
safe points of h. Note that we slightly abuse notation by not indicating 
the dependence on x for any of these definitions, but this will lead to no 
confusion. 

Let us consider a G T, x £ 91 and a homomorphism h : a — > We 
define the (E, Eq)- extension of a for i?o S IF and E : h — ¥ £fti to be the 
cr-forest 6 obtained by gluing a copy of E(w) to tt; for each w G /i° and 
further adding E'o- More precisely, we obtain b by taking the disjoint union 
of the cr-forests a, Eq and [-E(u>)] for each w £ U (a) and then identifying the 
root of E(w) with w for each w E h . We will identify the cr-forests a, Eq 
and with the corresponding substructures of b as long as this leads 

to no confusion. 

Let us fix the regular set R C F and consider C = {R x \ x G 91} and 
C" = {i? 2 I z G F}. Recall that R z was defined in Section g2J We call a 
map C —¥ {0, 1, 2} a Zist 

Let s£T, x E 9\, h : a — > [x + \ and let b be the (.E, £^o)-extension of a. 
We define the signature of this extension to be the triple (L±, L2, c'), where 
c' = R E ° G C and Li and L2 are lists defined by Li(c) = min(2, \ {w G h l \ 
Re{ w ) = c }|) f° r £ = 1, 2 and c G C. 

We say that x G 9t is compatible with the signature T if there is a G T, 
h : a —> [2+] and an extension 6 of a of signature T with b £ R. We say that 
x G £H is compatible with c G C" if there is a cr-forest a G F satisfying R a = c 
and a homomorphism a — > x_. If such a real homomorphism also exists we 
say that x is strongly compatible with c. 

We claim that if x, x' £ 9\ are compatible with the same signatures and 
the same elements of C and they are also strongly compatible with the same 
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elements of C and further x + = to if and only if x' + = to, then x ~ex(_r) Ui 
that is (EX(R)) X = (EX(R)) X >. 

Note that since R is regular, C and C must be finite (the latter by 
Lemma l4.3p . so there is a finite number of different signatures and thus the 
lemma implies that ~ex(r) has a finite number equivalence classes, in other 
words, that EX(R) is regular as claimed. 

It remains to prove the claim. Let x, x' satisfy the condition of the claim 
and y E d\ satisfy [x + y] E EX(R). By symmetry it is enough to prove that 
[x' + y] E EX(R). 

By the definition of EX(i?) we have a real homomorphism h :b —¥ [x + y] 
for some b E R. Our goal is to find another real homomorphism b! : b' —> 
[x' + y] with b' E R. We do the transformation step by step. In each step we 
have some bi E R and a homomorphism hi : foj — > [x+ + x' + y] using "less 
and less" the part of [x+ + x' + y] coming from x+ . 

Consider the substructure ao of b induced by the points h maps to x_. 
Clearly, x is compatible with d = R a ° . If h restricted to ao is a real ho- 
momorphism ao — > x_, then x is strongly compatible with c' . So x' must 
also be compatible with c! and, in the latter case, also strongly compatible 
with c' . Let a' Q E F and <? : a — ?■ x'_ show this, that is R a o = c' and the 
homomorphism g' is real if x is strongly compatible with c'. Let 61 = a + 6*, 
where b* is the substructure of b outside ao- From b = ao + b* E R 
we have 6* E ii a ° = c = i? a o and thus 61 = a' + b* E ii. We define 
foi : 61 — > [x + + x' + y] by making its restriction to a' be gr (this maps 
to x'_) and making its restriction to b* be the same as the corresponding 
restriction of b (mapping to [x + + y]). 

Next we give the recursion. Assume bi E R and hi : bi — )• [cc+ + x' + y] is 
given. We define the x-parts of 6j to be the maximal connected substructures 
of bi that map entirely to [x + ] (considered as a substructure of [x + + x' + y\). 
For simplicity we do not consider single point substructures of bi to be 
x-parts. We measure progress by the decreasing number of x-parts, that 
is, we make sure that has fewer x-parts than bi. This ensures that 
the procedure terminates with no x-parts left. If bi has no x-parts we set 
b' = bi E R and h' = h { : b' -> [x' + y\. 

Assume now that there is still at least one x-part of bi. As Inc(6j) is 
a forest with the x-parts being pairwise disjoint subtrees we can choose an 
x-part en that does not separate two further x-parts in this graph. Let us 
fix such an x-part a^ and let a; : aj — > [x+] denote the restriction of hi to 
aj. There is a unique way to express bi as an (Ei, £^j i o)-extension of af. we 
set Ei t o to be the cr-forest consisting of the components of bi other than 
the component a* containing aj, while for w 6 we set Ei(w) to be the 
substructure of a* that is separated from aj by w in the tree Inc(a*). We 
make Ei(w) include w as its root. Note that for w E U(di) \ g® the image 
gi(w) of w is a non-root point of x, so such a w cannot separate the x-part 
a from any points in a* as otherwise a would not be a maximal connected 
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substructure mapped to [x] . 

By our choice of a, if there are further x-parts in a* they must all be 
contained in a substructure [Ei{wi)\ for some single root point Wi G gf. 

Let Tj be the signature of the (Ei, £^o)-extension bi of ctj. Now a, G T, 
<7i : a — >■ [x+] and this £'j i o)-extension show that x is compatible with 
Tj. By our assumption x' must also be compatible with this signature. Let 
a! i G T, g\ : a' — > [x' + \ and its {E[, E[ )-extension b\ € R show this, that is, 
assume this extension has signature Tj. 

In order to be able to use = b\ we would need to define hi + \ : b\ — > 
[x + x' + y], but that is not always possible as some of the cr-forests [^(iw)] 
or E[ may not have a homomorphism to [x+ +x' + y\. Therefore we modify 
the extension first. 

We define fi : gf — >■ g® as follows. For each j = 1, 2 and u; G g'f we choose 
/»H G gj with Ei(fi(w)) ~ jR This is possible as Lj(R E ^ w) ) > 

for the lists Lj in Tj = (L±, L2,c'). If there are x-parts in a* beyond a\ we 
pick fi(w) = Wi for at most a single iw G gf '. This is also possible because 
if we have more than one w for which fi(w) = Wi is possible at all, then 
Lj(R Ei ( w .j) = 2 for the corresponding value of j = 1 or 2, so we have the 
freedom not to choose fi{w) = Wi for any w. 

We set E'l = E { o f u that is for w G gf we have E'/(w) = E^f^w)). We 
set bi+\ to be the (E", £'j i o)-extension of a-. We define : — > [x + + 
x' + y] through its restrictions. The restriction to a[ is g[, the restriction to 
Ei t Q is the restriction of bi to -E^o- Finally for t« G gf the restriction of frj+i to 
[E'l(w)\ is the restriction of bi to [E^/^u;))]. (Note here that fi(w) = fi(w') 
for distinct root vertices of g[ is possible as long as fi(w) / W{. In this case 
we have E'-{w) = E^w') = Ei{fi{w)), and the two substructures [E'f[w)\ 
and [E"{w')} are isomorphic, but naturally they are distinct substructures. 
This shows the limits of our notation, but hopefully leads to no confusion.) 
The restrictions given uniquely define the homomorphism hi + \ as the given 
substructures cover only the root points in gf are covered more than 

once and these points are mapped to the root of x + + x' + y in all the given 
restrictions. 

For the recursive definition to work we need to show that bi + \ is in R 
and it has fewer x-parts than bi. 

We start with showing that bi + \ G R. Note that Ei$ and E' iQ are R- 

equivalent since R Ei '° = R Ei <° is given in the signature Tj, thus the (E^, Ei^)- 
extension of a! i is in R if and only if the (E^, E[ )-extension is in R, but the 
latter is b\ G R. We have to consider E" instead of E[. As we always have 
E[{w) E"{w) a similar argument applies: a single such change does not 
alter membership in R. Doing these changes one by one we obtain that 
the {E'l , Ej i o)-extension bi + \ of o! i also satisfies bi + \ G R since the (£"-, -E^o)- 
extension is in R. 

Consider now the x-parts of bj+i. Some may be found in Ei$, but these 
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are also x-parts of 6j. Others may be found in some [E"(w)\ but only if 
[Ei(fi(w))] contains an x-part of b{. By our assumption this holds only for 
at most a single w 6 gf with fi(w) = Wi, so we have no more x-parts in 
6j+i than in 6j. In fact, we have fewer as was an x-part in bi and it got 
replaced by a- that is mapped to x'. 

We have defined the homomorphism h! : b' — > [x' + y] . Before finishing 
the proof of the claim by showing that this is a real homomorphism we 
make an easy observation. We call two distinct points in the universe of a 
cr-structure neighbors if they appear in a common relation, that is, if they 
are in distance two in the incidence graph. For any step i in the procedure 
above and any w £ gf the homomorphism maps all neighbors of w in 
[E"(w)] C bi + \ to non-root points of y. This is shown by an easy induction 
together with the statement that no point in bi has both a neighbor that 
hi maps to a non-root point of x+ and another neighbor that hi maps to a 
non-root point of x' + . 

Now we turn to the proof of h' being a real homomorphism. By Propo- 
sition 15.21 and since h : b — > [x + y] is a real homomorphism [x + y] has a 
component z with no restriction of h being an isomorphism to z. 

If ^ C [y] , then the part of h± that maps to z is copied from h, later the 
part of /ij+i that maps to z is also copied from hi, so as no restriction h is 
an isomorphism to z the same can be said about the last function h'. Here 
z is a component of [x' + y] either because z C y_ or because z = [y + ] and 
x + = to, in the latter case forcing x' + = to too. Again by Proposition 15.21 
no restriction is an isomorphism to the component z means that h' is a real 
homomorphism as claimed. 

If z C x_, then h restricted to ao is a real homomorphism to x_ as it has 
no restriction that is an isomorphism to z, so by the choice of g' Q : a' — > x'_ 
it is also real and we have a component z' of x'_ such that no restriction 
of g' Q is an isomorphism to z'. This means that no restriction of hi is an 
isomorphism to z' and, since the part mapping to x'_ is copied from hi 
to /ij+i, we conclude that no restriction of h! is an isomorphism to z' and 
therefore h! is a real homomorphism. 

Finally we consider the z = [x + + y + ] case with x+ 7^ to and thus 
x' + ^ to- Assume for a contradiction that h! is not a real homomorphism. 
By Proposition 15.21 we have a restriction of h' that is an isomorphism to 
z' = [x' + + y+\. No restriction of hi is an isomorphism to either z or z', the 
former because the relevant part of h± is copied from h, the latter because 
the non-root vertices of x' + do not even appear in the image of h±. Thus 
we must have an index i with no restriction of hi being an isomorphism 
to either z or z' but such that the restriction of hi+i to a substructure 
d of bi + i is suddenly an isomorphism to one of z or z' . We cannot have 
d C Ei .0 or d C [22" (u;)] for some ttf £ as then the restriction of hi 
to the corresponding substructure in bi would also be an isomorphism to 
z or z' . The substructure d is connected and it contains a single point 
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w G U(d) mapped to the root, so we must have w € gf and d is the union 
of its substructures do contained in a! i and d\ contained in [E"(w)]. Here 
do is not trivial and mapped to [x' + ], so h{+i must map d isomorphically to 
z' = [x' + +y]. We know that the neighbors of w in E"{w) are mapped by hi + \ 
to non-root vertices of y. As no point in U (d) other than w maps to the root 
we must have that h{+\ maps d\ to [y]. To make the restriction of hi+i to d 
an isomorphism to z' we must have that do maps isomorphically to [x+] and 
d\ maps isomorphically to [y + ] . The restriction to do makes w a danger point 
of so fi(w) € gf must be a danger point of gi with a substructure d' C a, 
containing fi(w) that maps isomorphically to [x + ]. Now hi maps the union 
of d 1 with the substructure corresponding to d\ C [E"(w)] in [i%(/j(iu))] 
isomorphically to z = [x + + y + ]. This contradicts our assumptions and 
proves that h' : b' —■ [x' + y] is a real homomorphism. 

Proving /i' is a real homomorphism finishes the proof of our claim and 
also the proof of the proposition. □ 

Note that by proving Proposition 15.51 we have established Theorems 15.11 
and 11.31 as well. 
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